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ABSTRACT 

Based on the assumption that changes in the 
educational experience require changes in the evaluation of student 
learning, this fourth guidebook in a series of nine video conferences 
on school restructuring presents information on the evolution of 
student assessment. Four shifts in educational assessment are 
identified: from testing to multiple assessments, from cognitive to 
diverse abilities, from uni- or bi-dimensional to multidimensional 
measurement, and from isolated to integral assessment. Also provided 
are pre- and post-conference activities, a program evaluation, essays 
and school-based activities highlighting conference topics, 
information about other video conferences in the series and computer 
forums, course credit information, a list of supplementary materials, 
73 references and 5 video sources, and a list of 9 regional 
resources. Biographical information is given on the conference 
presenters. (LMI) 
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Use 



of This Guidebook 



Guidebook Purposes 1. Before the video conference, the Guidebook provides pre- 

conference activities. 

2. After the video conference, the Guidebook contains a post- 
conference activity and program evaluation. 

3. The essay highlights topics discussed during the video con- 
ference. It is followed by two sets of activities: one set re- 
lates directly to the essay; the other set is school-based. 

4. Finally, this Guidebook provides information about the 
remaining video conferences in the series, the computer 
forums, course credit, and supplementary materials that are 
available for this professional development program. 



Instructions to the Site Facilitator 

Pre-Conference Before viewing the video conference: 

Activities 

(Allow 30 minutes.) ASK the participants to introduce themselves. If possible, have 

them form small groups or pairs. 

ASK the participants to complete the Prc-Confcrcncc Activities- 
These activities are on page 4 and are identified by the hand/pencil 
symbol. ^ 



Post-Conference After viewing the video conference: 

Activities 

(Allow 30 minutes.) ASK the participants to complete the Post-Conference Activity. 

This activity is on page 6 and is also marked by the hand/ 
pencil symbol. 

ASK the participants to complete the Program Evaluation. 

ADVISE participants that workshop activities have been included 
in this Guidebook These activities may be completed in schools, 
state education agencies, or other educational facilities. 
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NCREI&— 

The North Central Regional Educational Laboratory is a nonprofit 
organization devoted to supporting efforts of the educational com- 
munity by bridging .the gap between rfsearch and practice to pro- 
vide effective instruction for all students. NCREL is primarily 
funded through the Office of Educational Research and Improve- 
ment of the U.S. Department of Education. NCREL and PBS 
have been presenting national video conferences since 1987. 

$>FBS 

The PBS Elementary/Secondary Service acquires and distributes 
high quality, K-12 instructional television programs; provides 
professional development for educators; delivers electronic and 
print information services for and about Public Television (PTV) 
and education; serves as a national advocate for the use of tech- 
nologies; and tracks developments in national policy for the educa- 
tional television community. 

The PBS Adult Learning Sendee (ALS) offers college-credit 
television courses through local partnerships of public television 
stations and colleges. Since 1981 more than 1,500 colleges in 
cooperation with 300 stations have enrolled over one million stu- 
dents in ALS-distributed courses. In August 1988 ALS launched 
the PBS Adult Learning Satellite Service (ALSS) as a direct sa;ci- 
lite service for higher education, offering a wide variety of 
programming. 

© 1990 North Central Regional Educational Laboratory, 295 
Emroy Avenue, Elmhurst, IL 60126 

All rights reserved No part of this publication may be reproduced 
or transmitted in any form or by my means without permission. 

This publication is based on work sponsored wholly or in part by 
the Office of Educational Research and Improvement, Department 
of Education, under Contract Nwnber 400-36-0004. The content 
of this publication does not necessarily reflect the views ofOERI, 
the Department of Education, or any other agency of the U.S. 
Government. 
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OVERVIEW: PROFESSIONAL DEVELOPMENT SERIES 



NCREL's Goal: 
A Forum on 
Restructuring Schools 



The concept of educational laboratories emerged during the War 
on Poverty in the 1960s, Education was viewed as crucial to anti- 
poverty efforts, but the inability of policymakers, researchers, and 
practitioners to communicate with one another about effective 
strategies and practices was a significant obstacle to substantial 
educational improvement. One of the reasons Congress created 
the laboratories was to promote dialogue about promising prac- 
tices among these diverse actors. Today there are nine federally 
funded regional educational laboratories in the country working to 
help educators and policymakers improve the quality of education 
by applying research findings to educational practice. 

NCREL sees telecommunications as an effective vehicle for creat- 
ing a forum on restructuring schools that brings together prac- 
titioners, policymakers, and researchers so that they can enrich 
each other's perspectives. Telecommunications can bridge 
geographic separations and create networks of common 
stakeholders in restructuring efforts. 

However, the satellite transmission itself does not create a forum. 
How the telecommunications event is structured is a crucial factor 
in determining the effectiveness of the forum. This professional 
development series was designed to: 

• Focus the movement for restructuring schools on the fundamen- 
tal issues of schooling: learning, curriculum, instruction, and as- 
sessment 

• Provide opportunities for participants to interact with re- 
searchers, teachers and administrators, and policymakers in a 
structured thinking process 

• Help apply new ideas and develop local expertise 

• Promote a broad range of local and electronic networking 

• Help educators prepare students to meet the new roles and op- 
portunities of 2 profoundly changed and changing society 

• Provide a framework for organizing what research says about 
fundamental change 
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Components Of the Four components of this professional development series enhance 

Professional ^ e potential for creating a national forum: 

Development Series 

1. Video conferences 

2. Computer forums 

3. Print materials 

4. College credit 

See Additional Information, page 47. 



(1990) 



Video Conference 1. The New Definition of Learning: The First Step for School Reform 

Tities and Dates (February 14) 

Z The Thinking Curriculum (March 21) 

3. The Collaborative Classroom: Reconnecting Teachers and Learners 
(April 26) 

4. Multidimensional Assessment: Strategies for Schools (May 24) 

5. Schools as Learning Communities (June 6) 

6. Many Roads to Fundamental Reform: Getting Started (June 20) 

7. Many Roads to Fundamental Reform: Continuing to Grow (July 11) 

8. The Meaning of Staff Development in the 21st Century (July 25) 

9. Reconnecting Students at Risk to the Learning Process (August 8) 



Content The core message of the video series is this: A fundamental 

restructuring of schools hiiould be driven by a new vision of learn- 
ing, a vision which transforms all dimensions of schooling. Thus, 
the first video conference focuses on the new research on learning. 
The next three video conferences discuss the cognitive and social 
environments that can be created in classrooms to support mean- 
ingful learning. The last five video conferences explore changes 
that can be made in the social organization of schools to support 
these classrooms. 



VIDEO CONFERENCE ACTIVITIES 
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Pre-Conference Activities 
Post-Conference Activity 
Program Evaluation 
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Pre-Conference Activities 



INSTRUCTIONS TO SITE FACILITATOR: 



ASK the audience to form groups of 3 to 5 people. GUIDE them through the Pre-Conference Activities. 



Activity 1 : Can we 
change the way we use 



WRITE a sentence or two describing what your classroom would 
be like if the following things were to happen: 



assessment in our 
schools? 



(Allow 10 minutes.) 



♦ You could assess the important things you teach, not just basic 
facts and skills 

• Assessment were a natural part of your teaching rather than a 
disruption 

♦ Your students looked forward to assessment experiences 

♦ Your students could assess their own learning and could figure 
out what to do to improve Iheir own learning 

• Your students could demonstrate what they learned without fill- 
ing in bubbles on a computer answer sheet 

• Assessment informed parents and the larger community of the 
meaningful learning in which your students were engaged 
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Activity 2: What is this 
video conference about? 

(Allow 5 minutes,) 



SURVEY the essay, activities, and biographies in this guide to 
PREDICT what you will learn in this video conference. WRITE 
your predictions below. SHARE your predictions with a partner 
or grOMp if possible. 



Activity 3: What 
problems in assessment 
do you want this video 
conference to address? 

(Allow 10 minutes.) 



DESCRIBE two improvements in your classroom, school, district 
and/or state assessment programs that you want this video con- 
ference to help you make. 
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Post-Conference Activity 



INSTRUCTIONS TO SITE FACILITATOR: 

J 

ASK the audience to form groups of 3 to 5 people. GUIDE them through the Post-Conference Activity. 



Activity: How can this RESPOND. to the followir-g statements. SHARE your ideas with a 

video conference help ^jxtn^x or group if possible. 

you restructure your 

assessment program to 

include new ideas and 

principles of 

assessment? 

(Allow 1 5 minutes.) 



1. IMAGINE that you have been asked to describe one of the 
new views of assessment that you learned about in the video 
conference to a colleague or parent who may have difficulty 
understanding its value. DESCRIBE its purposes; its consis- 
tency with new learning, curriculum, and collaborative class- 
rooms; and its importance in restructured schools as you 
would to this colleague or parent. 



2. SELECT or CREATE two specific types of multidimensional 
assessment you could implement as part of your next report- 
ing period's evaluation in a content area you teach or super- 
vise. 



3. What strengths in your school, district, or state would support 
a multidimensional assessment program? DESCRIBE per- 
sons to contact and actions that students, teachers, ad- 
ministrators, and community members should take to support 
multidimensional assessment in your school. 



4. REVIEW your concerns about assessment in the Pre-Con- 
ference Activities. Did this video conference address any of 
those concerns? If so, WRITE below 'low it ha* helped. 



is 



Program Evaluation 



Please fill in the appropriate circles on your answer sheet using a #2 pencil and return it to your site facilitator, 
(Or send to: Debra Beauprez, 295 Emroy Avenue y Elmhurst y IL 60126.) 

On the Special Codes section of yc ur answer sheet please fill in your state : 1=IL;2 = IN;3 = IA;4 = MI; 5 = MN; 
6 = OH; 7 = WI; 8 = OTHER STATE; 9 = OUTSIDE U.S. 



PART ONE; Your opinions about the relevance and usefulness of the video conference 



Strongly 
Disagree 
< 



Strongly 
Agree 
> 



1. The topic of this video conference is relevant to my needs and interests. 


A 


B 


C 


D 


E 


2. The content of the video conference is appropriate to the type of 
community I live in and its schools. 


A 


B 


C 


D 


E 


3. I learned a great deal from this video conference. 


A 


B 


C 


D 


E 


4. The video conference enriched the way I look at cuueation. 


A 


B 


C 


D 


E 


5. The video conference may influence the way I educate (or involve myself in 
education as a parent or community member). 


A 


B 


C 


D 


E 



PART TWO: Questions about activities before, during, and after the video conference 
6. I am participating in this video conference: 



7 If you participated in this video conference in a team, who is involved 
in your team? 



8. Did the site facilitator conduct a pre-conference activity? 

9. Did you participate in a prc-confcrcnce activity? 

10. Did the site facilitator conduct a post-conference activity? 

1 1. Did you participate in a post-conference activity? 



A - Alone 
B - With colleagues (not in a team) 
C - In a school-based team 
D - In a district team 
E - Othrr 

A - State education/intermediate 

service agency staff 
B - Central office administrator 
C - School building administrator(s) 
D - Teachers 

E - Parents/community members 

A - Yes 
B-No 

A - Yes 
B-No 

A - Yes 
B-No 

A-Yos 
B-No 
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Have you completed any of the activities 12-16 as follow-up to any of the video conferences? 

12. Did you use any of the previous Guidebooks! A - Yes 

B-No 

1? Did you read this Guidebook! A - Yes 

B- No 

14. Did you complete the pre-conference activities in this Guidebook! A - Yes 

B- No 

15. Did you complete the post-conference activity in this Guidebook! A - Yes 

B- Mo 

16. This is my first video conference and I have not completed any A - Yes 
follow-up activities yet. B - No 



PART THREE: Your opinions about the content and delivery of the video conference 

Too Too 
Short Long 
< > 

17. How would you judge the overall length of the video conference? A B C D E 

Too Too 
Little Much 
< > 

18. How would you evaluate the amount of information presented in the A B C D E 
video conference? 

Please evaluate the following components or aspects of the video conference (questions 19-28): 

Poor Excellent 
< > 



19. Pre-conference activity 


A 


B 


C 


D 


E 


20. The video conference itseh 


A 


B 


C 


D 


E 


21. Post-conference activity 


A 


B 


C 


D 


E 


22. Presentations 


A 


B 


C 


D 


E 


23. Interaction with presenters 


A 


B 


C 


D 


E 


24. Pre-taped segments 


A 


B 


C 


D 


E 


25. Interaction with video conference participants at your site 


A 


B 


C 


D 


E 
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26. The technical quality of tiie video conference was good. 

27. The video conference site v/as conducive to learning. 

28. I would recommend this video series to others. 



Strongly 
Disagree 



Strongly 
Agree 
> 



A B C D E 
A B C D E 
A B C D E 



PART FOUR: Information about you 

29. Educators Only: Please indicate your school category on your answer sheet. A - Elementary school/junior high 

B - High school 
C - District 

D - College/University 

E - State/Intermediate Agency 



30. Educators* Only: Please indicate on your answer sheet your position. 



31. Nor-EducatorsOnly: Please indicate the primary group you represent. 



32. Circle the best description of your district. 

33. Did you view this video conference at a live site? 

34. How long did it take you to get to the video conference site? 



35. Did you participate in Video Conference 1 (either live or taped)? 

36. Did you participate in Video Conference 2 (either live or taped)? 

37. Did you participate in Video Conference 3 (either live or taped)? 



A - Teacher 
B - Administrator 
C - Staff 
D - Professor 

A - Parents 
B - Community 
C - School Board 
D - Business 
E - Social Services 

A - Urban 
B - Suburban 
C - Rural 

A- Yes 
B- No 

A - 0-15 minutes 

B - 16-30 minutes 

C - 31 minutes to 1 hour 

D - 1 hour to l-i/2 hours 

E - more than 1-1/2 hours 

A- Yes 
B- No 

A- Yes 
B- No 

A- Yes 
B- No 
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37 Please share any other comments about the ideo conference and suggestions for future videtfeonferences. 
(Use the section marked "comment" on your answer sheet) 

IS 
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Essay 

MULTIDIMENSIONAL ASSESSMENT: 
STRATEGIES FOR SCHOOLS 



Why Should Assessment Be Based on a Vision of Learning? 
What Are the Major Changes in Testing and Assessment? 
How Do You Implement Multidimensional Assessment? 

19 
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Why Should Assessment Be Based on a Vision of Learning? 



N3W Assessment for Guidebook 1 explores a new definition of learning which is based 
New Learning on cognitive, philosophical, aud multicultural research perspec- 

tives. These perspectives suggest that meaningful learning occurs 
when a learner has a knowledge base that can be used with fluency 
to make sense of the world, solve problems, and make decisions. 
Learners need to be self-determined, feel capable, and continually 
strive to acquire and use the tools they have to learn. They need to 
be strategic learners who have a repertoire of effective strategies 
for their own learning. Finally, they need to be empathetic 
learners who view themselves and the world from perspectives 
other than their own. 

As learning in schools is redefined, both the curriculum and the 
classroom environment need to be aligned. Guidebook 2 discus- 
ses the thinking curriculum which has a dual agenda of content 
and process for all students. This curriculum includes in-depth 
learning; involves students in real-world, relevant tasks; engages 
students in holistic tasks; and utilizes students' prior knowledge. 
Guidebook 3 in this series extends the new thinking curriculum 
into the classroom and suggests that the redefinition of learning re- 
quires a collaborative classroom which is notable for its change in 
the roles of students and teachers. The collaborative classroom is 
characterized by shared knowledge among teachers and students, 
shared authority among teachers and students, teachers as 
mediators, and heterogeneous groupings of students. 

These changes in the definition of learning, the curriculum, and 
the classroom context lead to Guidebook 4 — "Multidimensional 
Assessment." If indeed the shape of the educational experience 
forstudents is being changed, the ways that have been used pre- 
viously to evaluate successful student learning need to undergo a 
shift as well. This guidebook presents the evolution that is current- 
ly underway in the concept of student assessment and the im- 
plementation of this new vision of assessment in various 
educational institutions throughout the United States. Four shifts 
in learning and assessment are discussed: from testing to multiple 
assessments, from cognitive to a ran°e of abilities and talents, 
from assessments of one or two dim* sions to multidimensional 
assessment, from testing as an isolate i event to assessment as an 
integral part of instruction. 
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What Are the Major Changes in Testing and Assessment? 



From Testing to In the traditional schooling experience, student learning was most 

Multiple Assessment often measured only by testing: specific questions which (1) are 

tangible and structured and can be administered within a limited 
time period and (2) usually tap a limited number of cognitive 
knowledges and skills. Now, with the expanded concept of learn- 
ing, it is increasingly important to remember that paper- and pencil- 
testing is only one way to collect information about student 
learning. The broader concept of assessment is more appropriate. 
Assessment inc. ides paper- and pencil-testing but may also in- 
clude other procedures such as rating items on scales, observing 
student performances, critiquing student products, conducting in- 
terviews, and reviewing a student's background or previous perfor- 
mance. 



The concept of assessment broadens the kind of information that is 
collected about students and the way that this information is used 
in the evaluation of student learning. Assessment needs to tap and 
build upon the strengths that learners, in all their diversity, bring to 
the learning situation. 

New Assessment Gra^t Wiggins, senior associate with the National Center on 

Strategies Education and the Economy and a special consultant on assess- 

ment for the Coalition of Essential Schools, am 1 others have been 
developing new assessment strategies such as the portfolio and 
day-to-day assessment . A portfolio consists of student exhibitions 
that demonstrate mastery of the skills of inquiry and expression. 
Credit is given on the basis of what students can actually do in 
"showing off' their knowledge and know-how. The exhibitions re- 
quire wading, writing, questioning, speaking, and listening. Ex- 
hibitions are the culmination of a series of performances in an 
area, usually a graduation- level exercise or final class project. 

The staff at the Coalition of Essential Schools believes that re- 
quired periodic public exhibitions, focused on the student's ability 
to use and display knowledge intelligently, would better ensure 
that essential skills are taught and learned. Exhibitions can yield 
an authentic measure of students' abilities to engage in inquiry and 
skillful expression, and they can motivate and engage students by 
involving them in a public challenge, such as a project in a science 
fair or an in-class presentation. 
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Assessment performan ces are day-to-day activities that can also be 
authentic and engaging demonstrations of students' abilities to 
grapple with the central challenges of a discipline in real-life con- 
texts. Ideally,. these performances become an integral part of the 
instructional cycle, and feedback provided by the teacher and 
peers is meant to be formative — that is, it is intended to help the 
student assess his or her strengths and weaknesses, identifying 
areas of needed growth and mobilizing current capacity. Perfor- 
mances are provocations for what needs to be learned and exten- 
sions of what is learned and can help push the student to the next 
level of skill in performance. Performances become tools for 
reflection on learning accomplished and learning deferred. 

School-Eased Examples Many schools are designing and using innovative assessment 

strategies. Some of these techniques are called authentic assess- 
ment, performance-based assessment, portfolio assessment, 
process assessment, exhibits, demonstrations, and profiles. 
Regardless of the label, each of these techniques has moved 
beyond the concept of measuring student learning using multiple 
choice and other simple tests as sine's measures of student learn- 
ing at one point in time. 

English At South Msdford High School in Medford, Oregon, 
seniors must complete a three-part Senior Project to graduate. Stu- 
dents first choose a topic of interest to them, conduct research, and 
write a paper. Then they use the information in the papers to cre- 
ate real-life projects. While these projects are to satisfy require- 
ments for senior English, the rich variety of topics chosen makes 
these efforts interdisciplinary. One aspiring singer wrote and per- 
formed a song which she had learned to orchestrate. Another stu- 
dent wrote about Big Brother and Big Sister programs and 
recruited students to work with children fiom broken homes. The 
third phase of the proiect is a formal presentation before a panel of 
faculty and community members, some of whom are experts in the 
topic. Following the formal presentation, judges ask each senior 
several questions to evaluate impromptu speaking skills, 
knowledge level, and poise. 
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Writing Oregon's Lacomb Elementary School implemented a 
new writing program after staff enrolled in for-credit courses on 
teaching writing as a process and integrating writing across con- 
tent areas. Staff training also addressed cooperative learning, 
whole language learning, and assessment. Staff developed holistic 
scoring procedures to assess writing and document improvement 
over time. Assessment is ongoing in classrooms; students use feed- 
back from classmates and teachers to assess and improve perfor- 
mance. Conferences with partners and teachers, before and during 
writing, help students select topics and polish skills. Audiences 
are the class and the larger community: a Young Authors' Fair 
gave students opportunities to share their writing, illustrating, read- 
ing, and storytelling skills with parents and community members. 
In turn, local residents serve as role models by sharing their stories 
and poems with youngsters in school. 

Social Studies In his article, "Teaching to the (Authentic) Test" 
Grant Wiggins examines high school assessment strategies of two 
coalition schools. At Hope High School, Providence, Rhode Is- 
land, ninth grade students were asked to complete an oral history 
project based on interviews and written sources, and to present 
their findings in class. They selected their subjects from topics 
such as their family, running a small business, substance abuse, 
teenage parents, or recent immigrants. Students were then asked 
to create three hypotheses based on their preliminary investiga- 
tions and four questions they would ask to test each hypothesis. 
Students were evaluated on such criteria as whether they had inves- 
tigated three hypotheses, described at least one change over time, 
selected four appropriate sources for the interviews, asked valid 
questions, noted important differences between "fact" and 
"opinion" in answers, used evidence to prove the ultimate best 
hypothesis, and effectively organized their writing and presenta- 
tion to the class. 

A four-part final for a twelfth grade Humanities course at Thayer 
High School, Winchester, New Hampshire, asked students to 
choose a topic and construct their own final test subject to ap- 
proval by the project supervisor; submit a written report conform- 
ing to stated grammar requirements; make a multi-media, 
30-minute oral presentation; and serve on four evaluation teams of 
other students' presentations, playing a different role on each 
team- -either a journalist who summarizes important details or a 
coach who suggests improvements for the presentation. 



23 



15 



Science California teacher Cathy Kl/nesteker uses these closure 
activities for authentic assessment at Evergreen School in Cotton- 
wood: (1) At the end of a unit, students write a paper for another 
class of students (younger, older, or the same age) explaining the 
concept. Example: Sixth graders write a book for fourth graders 
explaining the cycle of a star. (2) Cooperative groups of students 
do an artistic representation (poster, model, videotape, slide show, 
etc.) of a concept. Example: For a communication unit, students 
created a poster demonstrating their understanding of elements of 
communication, including nonverbal, questioning, paraphrasing, 
and empathy. The representation must show the intend atedness 
and importance of each component. (3) Using equipment or a 
drawing (depending on the developmental stage of the students), 
students demonstrate understanding of a scientific principle such 
as an open electrical circuit; stream cutting during flood rtage of a 
river; or a food web in the ocean, a pond, a desert, a rain forest, 
etc. (4) With partners, students prepare a debate demonstrating 
understanding of two sides of a controversial issue. 

Math In the Mendocino Middle School, Mendocino, California, 
math and science teacher Cory Wisnia's assessment strategies 
evaluate students' knowledge of a specific concept or subject area 
and the life skills they need for the future. One of the ways Wisnia 
teaches real-life skills in math and science classes is through 
projects which also can serve as final measures of learning. He 
teaches a unit or concept and then assigns projects that 
demonstrate how well students understand the concept. For ex- 
ample, to assess area and perimeter relationships in math, Wisnia 
asked the class to use a particular constant, "say 1250 square feet," 
and design a scale model of a dream home, using graph paper for 
the floon;. These strategies help Wisnia judge how much learning 
the studeut retained. He found that, "While I thought my students 
fully understood area relationships before we started on the 
project, in fact they really learnei much more as they went along, 
trying to find answers to specific questions such as how many 
square feet should a bathroom be?" 
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At Hazen Union School in Hardwick, Vermont, math teacher Jean 
Hackett stresses performance assessment. Her students work in 
groups on these projects, Hackett encourages each group to try dif- 
ferent group approaches, such as brainstorming or "jigsawing" 
(each student is responsible for a "piece" of the puzzle) to solve a 
problem. For example, instead of having students multiply two 
numbers using z simple computation approach, she challenges 
them with a problem they can solve only by collecting data and 
using multiplication. When they are finished, each group has a 
product from which Hackett is able to assess both the math content 
her students know and their strategies. 

From Cognitive tO Historically, a very narrow concept of human intelligence has 

Multiple Abilities driven views of human learning. This concept was under close 

scrutiny in the late 70s when there were signs of reawakened inter- 
est in the theories and research of intelligence, Robert Sternberg, a 
psychologist at Yale University, was perhaps the most important 
catalyst to:; tins re-examination, although researchers from dif- 
ferent areas in psychology have joined in the rediscovery of an en- 
hanced concept of intelligence. 

Over the past two decades, Howard Gardner, a cognitive 
psychologist from Harvard University, has been developing a 
theory of multiple abilities, talents, and skills. Gardner argues that 
traditional schooling emphasizes only two abilities — verbal-lin- 
guistic (especially in written form) and logical-mathematical. Yet, 
there are many other kinds of knowledges or talents that enrich our 
lives and help us respond effectively to our environment. He lists 
the following, while emphasizing that there are many others as 
well. 

• Visual-spatial Capacity to perceive the visual-spatial world ac- 
curately and to modify or manipulate one's initial perceptions 

• Bodily-kinesthetic Abilities to control one's body movements 
and to handle objects skillfully 

• Musical-rhythmical Abilities to produce and appreciate 
rhythm, pitch, and timbre, and appreciation of the forms of 
musical expressiveness 

• Interpersonal Capacities to discern and respond appropriately 
to the moods, temperaments, motivations, and desires of other 
people 

• Intrapersonal Knowledge of one's own feelings, strengths, 
weaknesses, desires, and the ability to draw upon this 
knowledge to guide behavior 
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• Logical-mathematical The abilities to discern logical or 
numerical patterns and to handle long chains of reasoning. 

• Verbal-linguistic Sensitivity to the sounds, rhythms, and 
meanings of words; sensitivity to the different functions of lan- 
guage 

Expanding Views of Another individual who has been working to expand the way that 

Abilities and Skills thinking and learning is viewed is Protase "Woody" Woodford, 

Head of the Language Group, Testing Development, Educational 
Testing Service (ETS). He and his colleagues at ETS have been 
working in foreign languages to develop an expanded concept of 
the L -"ledge and skills necessary to be a successful learner of a 
foreign lai -"'age. 

Woodford believes that successful language proficiency assess- 
ment happens only when students are evaluated on their speaking 
ability. Since no oral tests were available, ETS developed a scale 
for assessing language proficiency based ou a test used by the 
U. S. Defense Language Institute. This scale measures proficiency 
at five levels: At the lowest level, Zero, students are unable to 
respond, even to a simple address such as "Hello." At the Novice 
level, students' skills range from "low" — recycling memorized 
material learned in class to "high"— conversing in very simple lan- 
guage. The third level on ETS' scale is Intermediate. At this 
level, students no longer rely on memorized information, but can 
carry on narrative conversations, though only in the present tense. 
The more advanced intermediate students are able to speak in 
either the future or the past tense, but not both. Advanced students 
are able to deal with descriptions and concepts not only in the 
present tense, but in the future and past and can do this regularly. 
The last level is Superior. These students **ave a full range of com- 
petency. They can deal with abstraction, negotiate ideas, and can 
use conditional "if clauses. 

Gardner and Woodford, as well as many others, continue to chal- 
lenge views of intelligence and learning that have traditionally 
directed the schooling experience. As these views evolve, it be- 
comes necessary to examine the impact they have on assessing and 
evaluating student learning. 
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Toward Gardner has suggested that traditional schools have emphasized 

Multidimensional lhe assessment of logical-mathematical and verbal-linguistic 

Assessment abilities, leaving other abilities out of the assessment process. 

Given the axiom that you "inspect what you expect" the message 
that continues to be sent to students is that only certain dimensions 
of learning are imporuUt. As different abilities and skills become 
increasingly valued in schools, new visions of assessment increas- 
ingly include assessment of the various abilities and skills. 
Moving to a concept of "multidimensional assessment" means that 
evaluation of students will be based on a broader concept of intel- 
ligence, ability, and learning. Not only will logical and verbal 
abilities continue to be, assessed, but assessment also w: I »nclude 
visual, auditory, kinesthetic, intrapersonal, and interpersonal 
abilities. This means assessing students' repertoire of learning 
strategies, skills in communicating with others, and knowledge as 
it is applied to day-to-day and culturally diverse contexts. 

Pie new vision of learning and evaluation of student learning 
reflected in the term multidimensional assessment is broad-based, 
relevant to real life, process oriented, and based on multiple 
measures which provide a rich portrayal of student learning. 



Figure \ Type of Assessment 

Authenticity 



dccontcxtuaiizcd, atomistic conlcxtuaiizcd/using skills in concept 



Number of 



Measures single 



multiple 



Dimensions 
of Learning 



simple 



complex 



Dimensions of 
Intelligence 



few 



many 
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Figure 1 portrays some of the aspects of multidimensional assess- 
ment. The first continuum shows a movement from decontextuai- 
ized, atomistic tests (short answer, fili-in blank, multiple choice, 
true/false, etc.) to authentic, contextualized tasks such as perfor- 
mances and/or products. The second continuum shows movement 
from a single measure of student learning to multiple measures. 
The third continuum depicts movement from simple to complex 
dimensions of learning while the fourth depicts movement from as- 
sessment of few dimensions of intelligence to assessment of many 
dimensions, MulUuimensional assessment taps the power and 
diversity of aciive learning, creates multiple sources of informa- 
tion to support instructional decision making, and helps students 
become more reflective and capable learners, 

A group of determined and dynamic teachers at Key School in In- 
dianapolis embraced Gardner's theories and worked with Gardner 
and his colleagues to develop a curriculum based on his ideas. 
Key School emphasizes the use of all kinds of abilities by stu- 
dents. In addition to instruction in mathematics and language arts, 
students also play the violin, speak Spanish, move their bodies to 
music, enter data into a computer and solve board games that em- 
phasize spatial skills. The curriculum is integrated through the use 
of schoolwide themes that span all grades and all subjects. 
Themes are studied in depth for nine weeks. 

In implementing the new curriculum, the staff found that stand- 
ardized tests were not usually useful in measuring the broad range 
of abilities fostered in the curriculum. Most tests measure only a 
narrow slice of children's linguistic and mathematical abilities. 
And even in these areas, the tests fail to reflect student's ability to 
think critically and creatively, their motivation to learn, or their 
capacity to engage in self-assessment. 

Due to the limitations of such tests, teachers at Key School had to 
develop assessment strategies that would yield richer, mc e qualita- 
tive information about student achievement and instructional effec- 
tiveness. Strategies developed include the following: 

♦ Videotaped portfolios document the learner's interests and ac- 
complishments ar.d assist teachers in evaluating each student's 
progress from year to year. The portfolios include tapes of an 
initial interview with the student and excerpts of his or her 
work throughout the year. Parents receive the videotape at the 
end of the year — it serves as a rich portrayal of their children's 
growth and an important supplement to information from 
report cards and results of standardized tests. 
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♦ Each student keeps a journal with weekly entries about the 
school's themes and his or her projects. 

♦ Students spend a part of each week in a media-rich room where 
they can choose from a range of board games, puzzles, audio 
tapes, and other materials requiring the use of one or more of 
the seven abilities. A teacher observes and records which ac- 
tivities children select and how they tackle problems. That in- 
formation will be combir zd with other evidence about the 
learner's interests and strengths to form a profile for each stu- 
dent. 

♦ Students also carry out an original project each nine-week grad- 
ing period on a theme that encourages students to think across 
subject lines. One theme was "connections," which explored 
how people are connected to their environment. As a project in 
this theme area, one student constructed a diorama showing 
ways in which turtles interact with people. Students are helped 
to assess their own projects by considering how well they il- 
lustrate the theme. These projects become part of the student's 
portfolio, documenting for both the teacher and the student his 
or her growth over time. 

o 

Isolated Versus Teaching to the Test Accompanying the move from a single test 

Integrated as a measure of student learning to multidimensional assessments, 

Assessment ^as been a move to integrate assessment into the classroom instruc- 

tional process. Viewing a test only as an "event" signaling comple- 
tion of instruction is no longer appropriate for the new vision that 
learning is a process in which students orchestrate learning 
strategies in i dynamic flow as they move in and out of different 
tasks and phases of learning. Assessment, too, needs to be con- 
sidered as an ongoing dynamic process. 

Figure 2 shows assessment as part of a process which enables stu- 
dents to become successful learners. Assessment, in this 
schematic, becomes the feedback that enables students to be 
strategic in their own learning process and enables teachers to 
adapt the instructional process to meet the needs of their students. 
Assessment helps teachers communicate expectations and stand- 
ards of learning and performance to students. Assessment helps 
students gain information about what is valued, set personal 
academic expections, internalize the required knowledge and 
skills, promote their self-knowledge about performance, under- 
stand who is in control of learning, and improve their learning. 
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Figure 2. Assessment and Instruction 
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Student Learning 



Instructional 
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Student Learning 
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Stuuent Learning 



Successful 
Learning 



The direct linkage between expectations, instruction, and assess- 
ment is evident in Figure 2. The expectations for learning will 
drive both the instructional and assessment process. If it is impor- 
tant that expectations and assessment be linked, then it is also ap- 
propriate to say that a teacher should be teaching to the assessment 
given that assessment is authentic. Without a clear relationship be- 
tween the two, neither students nor teachers can use assessment in- 
formation to its greatest potential in promoting learning. 

Examples of dynamic and ongoing assessments that enable 
teachers to modify instruction as needed are the techniques 
developed by Campione and Brown and by Weinstein and her col- 
leagues. While greater attention to these strategies will be given in 
Guidebook 9, it is helpful to mention them here. 
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Dynamic Assessment The concept of dynamic assessment is a 
natural extension of the idea of integrating assessment and instruc- 
tion. Based on pioneer work done by Jensen and Feuerstein, Cam- 
pione and Brown are developing dynamic assessment techniques 
for daily use in the classroom. Teachers employing these techni- 
ques present students with increasingly explicit cues and prompts 
for performing a task. Teachers may limit support by giving hints 
about the general approach to a particular problem or they may 
need to provide a specific blueprint for solving a problem. The 
number of hints required for the student to solve each problem ser- 
ves as a measure of learning efficiency. The fewer the cues given, 
the higher the learning efficiency; the greater the number of cues 
given, the lower the learning efficiency. The assessment of learn- 
ing efficiency focuses on how much help is needed for students to 
reach their learning potentials in a particular domain, rather than a 
static measure of what has already been acquired. 

Assessment of Learning and Study Strategies Weinstein, 
Schuite, and Palmer have constructed an instrument, called the 
Learning and Studying Strategies Inventory (LASSI), that 
measures the use of strategies among secondary and postsecon- 
dary students. It identifies students' weaknesses and provides data 
on the effectiveness of training programs for students who have 
poor learning and study habits. Students' attitude, motivation, 
time management, anxiety, concer. don, information processing, 
study aids, self-testing, and test strategies are measured. The test 
focuses on modifiable behaviors in le^ ning. For example, <n the 
area of motivation, students are assessed on their diligence, seif- 
discipline, and willingness to work hard. LASSI enables educators 
to help students become self-directed and self-managed learners. 

The new vision for learning requires an educational environment 
where instruction and assessment are integrated and where assess- 
ment is not considered to be a single event. The concept of 
dynamic assessment as an active process in which students and 
teachers participate provides a model for new assessment techni- 
ques which are aligned with the new vision for teaching and learn- 
ing. 
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How Do You Implement Multidimensional Assessment? 



In one sense, much of this essay has been devoted to providing 
rich examples of multidimensional assessment. Other issues must 
also be addressed. Schools need to examine their learning and cur- 
ricular goals and then select tasks that validly assess these goals. 
Indeed, part of the problem with more traditional assessment tasks 
has been their misinterpretation and misuse, not only by some 
schools, but also the public These dangers are not eliminated 
simply by adopting new forms of assessment, but by soul-search- 
ing consideration of the whole range of issues surrounding assess- 
ment. 

Some states have taken leadership in developing criteria for such 
assessment and others are following their lead. Teachers and other 
school staff can assume local leadership roles in setting and apply- 
ing criteria for assessment procedures that are reliable and valid. 
For example, portfolios and exhibitions will not of themselves en- 
sure that the problem of student assessment has been solved. 
Teachers need to understand issues of reliability and validity as 
they relate to these new tasks. What makes a portfolio "good?" 
Will one teacher view a student's portfolio as excellent and 
another view it as mediocre? What guidelines ought teachers pro- 
vide to students for judging their own work, thus encouraging 
valid self-assessment? 

The problem inherent in these questions is that teachers may use 
their own idiosyncratic criteria for evaluating portfolio performan- 
ces and other assessments. All members of a school staff need to 
develop common sets of criteria for judging students' work. Such 
ciforts are more likely to result in valid and reliable assessment. 
And by participating in the process of setting criteria, teachers will 
be more IPcely to understand and adhere to these criteria. 
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Purposes Of Testing The call for educational accountability throughout the United 

States has had a great impact on the assessment practices in the 
public schools. Historically, testing was primarily the domain of 
the classroom teacher. Today, federal program requirements, state 
and district accountability concerns, testing for minimum com- 
petency, testing for special diplomas, testing for admissions, and 
national/international assessments have made required assessments 
prevalent in the schools. As this movement continues it becomes 
increasingly important that educators design an assessment pro- 
gram which has a clear purpose for each assessment and a clear un- 
derstanding of the use that will be made of the assessment data. 

Generally, the overall purpose of student assessment is to provide 
valid information for decision making. Since educators, students, 
parents, the public, and governmental agencies make many dif- 
ferent types of decisions, assessments need to be designed for a 
variety of specific purposes. The purpose of each assessment 
should be directly related to decisions about students. Those 
decisions, in turn, are related to decisions about educational 
programs in schools, districts, states, and nations. Some decisions 
about students made from assessment information are: 

• Diagnosis Monitoring students' strengths, weaknesses, and 
progress in specific areas 

• Placement Matching students to appropriate levels of instruc- 
tion 

• Guidance and Counseling Helping students make appropriate 
educational and vocational decisions 

• Admissions Choosing students to be admitted ; lto various 
programs 

• Certification Determining mastery of specified criteria 
Some decisions made about educational programs are: 

• Evaluation Judging the value and effectiveness of instruction- 
al programs and delivery systems 

• Accountability Reporting results to specific publics 

• Research/Planning Identifying educational areas requiring 
further study 
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Criteria for an Although there are jnany purposes for assessment data and many 

Assessment Program different decision makers who use this information, an important 

consideration for schools and districts continues to be the align- 
ment between expectations, instruction, and assessment. Schools 
continue to be bombarded with expectations placed on them from 
society by state, district, legal and other requirements; available 
tests and other instructional materials; and professional standards. 
With these increased expectations, the issue of alignment becomes 
increasingly difficult, bat essential to understanding the meaning 
of assessment information. 

According to Joan Herman, UCLA Center for Research on Evalua- 
tion, Standards and Student Testing (CRESST), educators will be 
increasingly challenged (1) to articulate the significant outcomes 
which constitute their new vision of multidimensional learning; 
(2) to design and implement effective strategies to help students 
achieve these outcomes; (3) to assess the extent to which these ou.. 
comes are attained in fair, valid, and appropriate ways; and (4) to 
use the results of these new assessments to improve student learn- 
ing. The match between significant learning goals, instructional 
programs, and assessment tools is a key element in implementing 
such an approach; the match, in fact, undergirds the validity of the 
assessment itself. At present, however, the match is problematic: 
traditional assessments simply do not adequately reflect the new 
vision and their utility thus is limited. New measures will have to 
be created. 

Focusing more directly on criteria for the assessments themselves, 
Sheila Valencia states the following: (1) Sound assessment is 
anchored in authenticity — authenticity of tasks, texts, and con- 
texts. This means assessing the orchestration, integration, and ap- 
plication of skills in meaningful contexts. (2) Assessment must be 
continuous. ITiis means that drafts, plans, and sketches become as 
important a part of the total picture as final products. (3) Assess- 
ments must measure or sample a wide range of cognitive processes 
and/or abilities. (4) Assessments must provide for active, col- 
laborative reflection by both teacher and students. This means that 
students must also be active participants in designing assessment 
tasks and be given increasing responsibility for using assessment 
data to monitor and improve their own learning. 
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Some additional criteria for developing assessments should be con- 
sidered. First, assessments should be fair to different cultural and 
family backgrounds as well as actively access and mobilize the uni- 
que resources-bestowed upon learners because of their back- 
grounds. Second, assessments should have a variety of real 
audiences, beyond a solitary teacher, including peers, parents, and 
community members. 

A Call for a New Dissatisfaction with the limitations of testing and continued faith 

Vision Of Assessment m the value of creative muitifaceted assessment has given rise to 
in Education proposals for new assessment alternatives at all levels of educa- 

tion, from the National Assessment of Educational Progress, to 
those charged with responsibilities for state and district assess- 
ments, to those interested in better classroom assessments. The un- 
derlying ideas of all these pioposais share some coniLion threads: 
These alternative assessments ask students to perform, create, 
produce or do something that requires them to use higher-level, 
problem-solving skills; the assessment tasks themselves represent 
meaningful instructional activities; the taj>ks themselves are also 
relevant to real-life tasks or represent those that are common to a 
particular discipline. Connecticut and California are among those 
states dealing with large scale assessment in innovative ways. 

California California's Department of Education believes that a major pur- 

pose of assessment is to evaluate the quality of learning. Recog- 
nizing that multiple-choice tests traditionally used in large-scale 
assessment measure only isolated skills and facts, the California 
Assessment Program's (CAP) goal is to measure students' ability 
to apply \vfiat they have learned to real-life situations. CAP will 
align assessment with California's new curriculum mandates — that 
curricula be literature-based, value-laden, culturally-rich, and in- 
tegrated across content areas. Assessment will reflect new out- 
comes — that students gain the knowledge and skills necessary to 
analyze, organize, interpret, evaluate, and communicate life ex- 
periences. 

New types of assessment being introduced include open-ended 
questions, essay, portfolio, oral, and integrated performance assess- 
ments. The new program also calls for assessment in more content 
areas at more grade levels. 
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In the mathematics area, open-ended questions allow students to 
solve problems creatively and construct ar rwers that demonstrate 
the depth of their understanding. When answers are written, stu- 
dents are able to show others how to solve problems, and teachers 
gain important insights into how much a student knows. An ex- 
ample at the twelfth grade level is: 

James knows that half of the students from his school are 
accepted at the public university r»earby. Also, half are 
accepted at a local private college. He thinks that this adds 
up to 100 percent, so he will surely be accepted at one or the 
other institution. Explain why James may be wrong. If 
possible, use a diagram in > jut explanation. 

A team of teachers is developing an integrated language arts as- 
sessment tool. Assessment of students' work occurs as they are 
engaged in typical classroom activities - reading, talking, writing, 
and thinking about literature and human experience. Assessment 
tasks challenge students to discover what is important, meaningful, 
and valuable in a text and to write responses that give evaluators 
insight into the processes of student thinking and construction of 
meaning. The goal is to develop students* capacities for flexible, 
insightful, productive thinking. For example, eighth grade stu- 
dents are asked to write an evaluative essay about the worth of a 
book or type of music and then support their judgments. Students 
set criteria, analyze the subject, and select evidence to support 
their judgments. 

In science, students will demonstrate knowledge of scientific con- 
cepts and processes, problem-solving ability, and performance of 
scientific investigations. For example, given a handful of 
materials, sixth grade students are asked to design and perform an 
experiment to determine which of two magnets is stronger. Open- 
ended questions are also used; they engage students in creating 
hypotheses, designing investigations, and writing about social and 
ethical issues in science. 



3C 



23 



Assessments of student achievement in history and social sciences 
will allow students to demonstrate breadth of learning as well as 
the ability to clarify issues, recognize relationships, determine 
causes and effects, interpret evidence, and argue for a position. 
Test instruments will assess a deep knowledge of eras and events 
rather than isolated minutiae. Testing will provide feedback on a 
new enriched curriculum which immerses students in a historical 
context, involving them in the literature, historical documents, and 
lives of tue people of an era. Assessment activities include debat- 
ing, dramatizing, and defending a point of view orally or in writ- 
ing. Finding out how well students can think about history will be 
as important as finding out what they know. 

Responses from both teachers and students to field-testing 
programs have been very positive. Students actually enjoy taking 
tests and teachers are eager to receive training. 

The state of Connecticut is also a leader in the use of multidimen- 
sional assessment. It is being driven by a carefully articulated 
vision of learning, Connecticut's Common Core of Learning 
(CCL). 

The Common Core, adopted in 1987, set^ forth what the state 
believes should be the outcomes of education in its public schools. 
It details what graduates should know and be able to do as a result 
of the entire K-12 school experience. The Core is meant to pro- 
vide integrated and interdependent learning outcomeo in three 
major arcis: Attributes and Attitudes, Skills and Competencies, 
and Understanding and Applications, The state emphasizes that 
CCL is not meant to define minimum competencies, but rather a 
set of standards for an educated citizen. Although the Core is not 
mandated, it is meant to give local districts a clear direction as 
they develop curriculum. 

In conjunction with the Common Core of Learning, the Connec- 
ticut State Department of Education initiated a multi-year assess- 
ment project to measure the extent to which their students are 
achieving the outcomes described in the Core. They are working 
to develop a new model which includes exhibitions, hands-on per- 
formance experiences, student portfolios and other tasks that re- 
quire students to demonstrate knowledge-in-use. 

Illustrative of the CCL performance tasks is the Food Market Com- 
parison described below. 
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Many local food markets claim to have the lowest prices. But 
what does this really mean? Does it mean that every item in 
their store is priced lower, or just some of them? How can 
vou reallv tell which- supermarket will save vou the most 
money ? Your assignment is to design and carry out a study 
to answer this question. 

The students are directed to work in small research groups to 
design, undertake, and evaluate a study. They are graded on their 
group work and their individual reports on the project. Each stu- 
dent is also required to keep a log documenting the process. 

Connecticut also provides sustained training and support to 
teachers in order to help them (the teachers) understand, design, 
and evaluate performance tasks. 

The segments of this program reflect continuing belief in the im- 
portance of assessment — for acceptability, program and cur- 
riculum improvement, and feedback to teachers, parents, and 
students — but strongly call *or new perspectives on assessment 
and alternative measurement approaches. Hard thinking about 
what students should accomplish, how they should develop, and 
what specific components they need to acquire are the basic build- 
ing blocks for constructing better visions of assessment for the fu- 
ture. 
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ESSAY ACTIVITIES 



Why Should Assessment Be Based on a Vision of Learning? 
What Are the Major Changes in Testing and Assessment? 
How Do You Implement Multidimensional Assessment? 
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Why Should Assessment Be Based on a Vision of Learning? 


Activity: Are your 


This activity can be done with a group of teachers. REVIEW your 


assessment practices 


vision of learning from Guidebook 1 and WRITE it below. LIST 


consistent with your 


examples of assessment activities you currently use, and IDEN- 


vision of learning? 


TIFY ways they are consistent or are not consistent with your 




vision of learning. CREATE some ways to change these activities 




so that they are more consistent with your vision of learning. 




Your vision of learning: 




How are they consistent 


Activities 


or not consistent? Wavs to Change 
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What Are the Major Changes in Testing and Assessment? 



Activity 1 : Does your COMPARE your vision of learning to Gardner's. EXPLAIN if 

vision of learning include and how your vi5*^n of learning reflects his multiple abilities. 

multiple abilities or only This activity * done with a group of teachers. 

verbal and 

logical-mathematical 

abilities? 

How does your vision include these utilities?: 
Verbal 



Musical" 



Logical-Mathematical 



Spatial 



Bodily- Kinesthetic 



Intrapersonal 



Interpersonal 
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Activity 2: How can you WRITE examples of testing and assessment activities you current- 
change from testing to ly do below, when (time of the year) you do it, how often do you 
assessment? do it over a year, and your purposes for doing it. PUT a check 

mark next to the activities that are traditional testing. REVISE 
those activities to be consistent with assessment . To help you do 
this, REVIEW examples in the Guidebook and READ the ex- 
amples below. This activity can be done with a group of teachers. 

Example 1. Science (from Cory Wisnia, Mendocino, California): 

After learning about genetics, students design their own genetic family with 
several observable traits. Then the class, as a limited "gene pool" island cul- 
ture, intermarries through several generations, creating family trees. Students 
then write a family history with a photo album from the viewpiont of a third- 
generation member of their imaginary family. 

Example 2. Fnglish (from Carleen Osher, South Medford High 
School, Medford, Oregon): 

All seniors arc required to complete a senior project. Students write an eight- 
to ten-page research paper, create a related project; and speak to a panel of ex- 
perts about their project, the research, and their personal growth. For example, 
one student composed a song, performed it for the panel, and discussed the 
musical arrangement of it that she created for a 20-piece band. 

Current Activities When How Often Purpose 



Revised Activities When How Often Purpose 
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Activity 3: How can you 
change from unilateral to 
multidimensional 
assessment? 



CREATE 0£w assessment activities that are not in the logical- 
mathematical or verbal domains. Be sure your activities reflect 
multidimensional assessment and are responsive to linguistic 
minority students. This activity can be done with a group of 
teachers. 



Activity 



Domainfe) assessed 



How is this activity responsible to 
the needs o f minority students? 
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Activity 4: How can you This activity can be done with a group of teachers, 
change from isolated to 
integrated assessment? 

DESCRIBE how you would integrate learning, teaching, and as- 
sessment in your classroom and school. 



EXPLAIN why or why not dynamic assessment is appropriate for 
your students. 



DESCRIBE dynamic assessment you already provide or could pro- 
vide that will help your students learn. EXPLAIN why you think 
dynamic assessment is important. 
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How Do You Implement Multidimensional Assessment? 



Activity 1: What criteria 
can heip you implement 
multidimensional 
assessment in your 
classroom? 



This activity can be done with a group of teachers. 



REVIEW the criteria discussed in this guide and ADAPT them so 
they are appropriate for assessment in your classroom and/or 
school. EXPLAIN how you could ensure that you meet your 
criteria. 



Activity 2: How can you 
integrate multi- 
dimensional assessment 
with instruction? 



SELECT a unit you will teach (or revise one you have taught). 
(You may use the same unit planned in Guidebook 2 or J.) SUM- 
MARIZE your goals and objectives for the unit with regard to con- 
tent and thinking skills and collaborative roles. PLAN how you 
will assess students, using at least two types of assessment. 
DESCRIBE the benefit of your assessments for students, parents, 
or others. 



Goals and objectives 



Assessments 



Benefits to students parents, others 
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SCHOOL-BASED ACTIVITIES 



Activity 1 : Preparing for Change 
Activity 2: Getting Started 
Activity 3: Continuing to Grow 



Note: The activities in this section arc sequenced to address different levels of involvement in the restructuring 
process. Begin by selecting the activities best suited to your school. 
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Activity 1 : Preparing for Change 



This activity should be done with a group of teachers and administrators, and parents (if possible). 



Part A: How can you 
plan changes in testing 
and assessment 
practices in your school 



New views of assessment described in the Guidebook and the 
video conference should not be planned without attention to the 
mission of your school, its vision of learning, curricular goalr and 
objectives, and a new vision of instruction. Below are steps for 
changing assessment practices that take these factors into account. 



STEP 1: DETERMINE your school's mission and your vision of learning. WRITE them below. 



Mission: 



Vision of learning: 
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STEP 2: WRITE curricular goals based on your mission statement and vision of learning. 
ANALYZE the strengths and weaknesses of your current assessment practices for achieving your 
vision of learning and your curricular goals. 

Curricular goals 



Strengths of current assessment practices 



Weaknesses of current assessment practices 



STEP 3: DEVELOP general assessment goals based on your analysis of current practices and 
sample strategies and activities for assessment practices that (1) are multiple assessments rather than 
isolated tests, (2) tap multiple abilities, (3) are multidimensional, and (4) are integrated with teaching 
and learning. 

Goals 



Sample strategies and activities 
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STEP 4: The next step fs to think about the implications of implementing new assessment practices. 
Some factors will inhibit change. As you work to achieve your goals, you are likely to find resistance 
within yourself as well as externally. The Guidebook pointed out that schools and teachers within 
them mus* respond to mandates and expectations of state, district, professional standards, parents, and 
society at large. EXAMINE factors listed below that may prohibit change. ADD your own ideas. 
Then, BRAINSTORM and DESCRIBE ways to overcome each factor. 

Factors that prohibit change Wavs to overcome 

Personal 

Colleagues 

Funding 

Time 

Research 

Consultants 

Community/business 

District 

State 

Parents 

Current schedules 

Current reporting and grading procedures 
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STEP 4 (continued): BRAINSTORM and LIST factors in your school that will facilitate changing 
assessment practices, and DESCRIBE how these factors can facilitate change and how you can make 
the best use of them. 

How they facilitate change and 
Factors that facilitate chang e how you can make the best use of them 



Part B: How can you WRITE an action plan for accomplishing your goals, 

implement your goals? 

What is an example of vhat can you do immediately? 



What is an example of what can you do in the next few months? 



What is an example of what can you accomplish by the enc of the 
next school year? 



50 



42 



Activity 2: Getting Started 



This activity should be conducted by teachers, administrators, and parents (if possible) involved in 
restructuring in your school or district. 

Part A: How can you use 1. FORM small groups (3-5 people per group). Each group 
portfolios and should PLAN how to use portfolios in the content area of 

performance-based their choice by answering the following questions, 

assessment? 

a. What will be the purpose of the portfolio? 



b. How will decisions be made regarding the specific pieces 
the portfolio will contain? 



c. What will the portfolio contain? 



d. How will the teacher use the portfolio? 



e. How will the students use the portfolio? Why will it be 
valuable to him/her? 



f. How will the parents use the portfolio? What will it com- 
municate to them? 
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g. How will the portfolio be evaluated — what criteria will be 
used? 



h. Who will evaluate the portfolio? 



i. How often will it be evaluated? 



Each group should also PLAN for the use of a performance- 
based assessment in the content area of their choice by 
answering the following questions. 

a. What types of performance will be required? 



b. Who will determine the specific performance? 



c. How will the performance be evaluated — what criteria 
will be used? 



d. Who will evaluate the performance? 
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Part B: What 
contributions can 
individuals on your staff 
make for changing 
assessment? 



1. FORM small groups (3-5 per group). Each person should 
DESCRIBE the contributions they want to make to changing 
assessment practices in your school. 



2. SUMMARIZE the contributions within each group and then 
COMBINE the lists to summarize the contributions to be 
made in the whole school. 



3. ADD contributions to the action plan outlined in the Prepar- 
ing for Change section. 
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Activity 3: Continuing to Grow 


How do your current 


ANSWER the following questions as they relate to changing as- 


restructuring efforts 


sessment practices in your school or district. 


address new 




assessment? 






1. What school or district efforts are underway to restructure in- 




struction and assessment? 




2. What support networks are available to teachers, ad- 




ministrators, parents, and others involved in your school or 




district's restructuring efforts? What additional support 




would be valuable? What can be done to garner such support? 




3. What revisions or additions would move your efforts closer 




to a thinking curriculum that includes the use of collaborative 




classrooms and multidimensional assessment? 




4. What school or district efforts are underway to invoh e 




parents and the community in restructuring? These may in- 




clude efforts to educate parents and the community on what 




changes are being made and why they are being made, or ef- 




forts to involve them in planning. 




5. What efforts or planned efforts exist to involve students in 




restructuring efforts? 
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ADDITIONAL INFORMATION 



Program Descriptions 1. The New Definition of Learning: The First Step for School 

Reform * The point of departure in thinking about restructuring is 
to consider a new definition of learning based on recent research in 
cognitive sciences, philosophy, and multicultural education. Posi- 
tive attitudes toward learning, toward oneself, and toward others; a 
strategic approach to learning; and self-regulated learning are key 
goals emerging from this research. While these perspectives build 
on earlier approaches to active learning, they are "new" in contrast 
to traditional models of schooling. Also, it is especially important 
in our changing and changed society to promote mea .agful learn- 
ing among all students. The vision of meaningful learning 
developed for a restructured school will determine the curriculum 
objectives, classroom instruction, assessment, and the social or- 
ganization of the school. 

2. The Thinking Curriculum - If students are to engage in mean- 
ingful learning, numerous curricular issues must be addressed. A 
dual agenda must be implemented focusing both on enriched con- 
tent and expanded notions of higher order thinking. Otherwise, 
students will learn isolated skills and facts as ends in themselves. 
If schools are to become communities of scholars, collaborative 
learning and the interpersonal skills needed to support it must be- 
come part of the curriculum. Activities to develop seif-regulated 
learning and motivation must become part of the curriculum for 
students of all ages and abilities, but especially for students at risk 
and younger students. Finally, higher-ord^r thinking and reason- 
ing must pervade the curriculum from K-12. 

3. The Collaborative Classroom: Reconnecting Teachers and 
Lear- ;rs - If there are profound changes implied from the new 
definition of learning for what students learn, there are equally 
serious consequences for the roles of teachers in the classroom. 
Teachers will need to facilitate, mediate, model, guide, assist, 
share, listen, and adjust the amount of support provided. 
Moreover, many teachers will need to develop strategies for teach- 
ing diverse students within heterogeneous classrooms. 
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4. Multidimensional Assessment: Strategies for Schools • If 

the curriculum is to change, the current debate over the usefulness, 
or uselessness, of standardized tests is likely to be intensified. It 
makes little sense to redesign curricula to teach for understanding 
and reflection when the main assessment instruments in schools 
measure only the assimilation of isolated facts and effective perfor- 
mance of rote skills. Alternative assessment methods must be 
developed to evaluate and increase the capacity of learners to 
engage in higher order thinking, to be aware of the learning 
strategies they use, and to employ multiple intelligences. Alterna- 
te w modes of assessment are valuable both to stud^s in promot- 
ing their development and to teachers ir ; * 
effectiveness of their instruction, 

5. Schools as Learning Communities - In ^ ' that are learn- 
ing communities, students' learning and teachers' instruction use 
the community and its resources. In addition, the schools promote 
learning as a lifelong activity forall citizens. As a result, com- 
munity members increasingly spend more time in schools to learn, 
provide support services such as tutoring and teaching, and par- 
ticipate in school life. More and more, schools of the future will 
be places where administrators and teachers learn and work col- 
laboratively. Schools as learning communities may also mean 
working with local businesses and agencies to provide increased 
support services to help students and their families become better 
learners. 

6. Many Roads to Fundamental Reform in Schools: Getting 
Smarted • Teacher: and administrators who form learning com- 
munities reflect as a group on schooling and learning — they probe 
their assumptions about learning, they debate what they see as es- 
sential in the education. 1 experience, and they build consensus on 
what vision of learning will undergird their school's mission. In- 
itiating a broad-based dialogue comparing learning that should 
occur to learning that is actually occurring is a first step in getting 
started. A broad-based dialogue includes community members, 
parents, teachers, administrators, and students. In furthering the 
dialogue, participants should pursue the implications of their new 
definition of learning for all dimensions of schooling — curriculum, 
instruction, assessment, school organization, and community rela- 
tions. 
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7. Many Roads to Fundamental Reform in Schools: Continu- 
ing to Grow - If all participants in this school community are suc- 
cessful learners, then they know that the process of learning is 
ongc 'ng and iterative. They know that schooling and learning are 
driving concepts that must be repeatedly developed in their mean- 
ing. Participants are continually learning and re-learning what the 
mission of the school is., what the vision of learning should be, 
how to realize this vision, and the many subtle ways the vision is 
impeded by organizational and attitudinal constraints. Formative 
evaluation of the restructuring process becomes "business as 
usual" for the school. 

8. The Meaning of Staff Development in the 21st Century - 
Traditional roles of staff development for teachers and principals 
focusing on one-shot events are as outdated as traditional models 
of learning. Therefore, a major task of the restructuring movement 
is to align models of staff development with new visions of learn- 
ing to allow teachers and administrators to plan together sustained, 
high-quality staff development programs. Video Conference 8 
focuses on developing new roles for teachers and administrators 
based on research on expert teaching and staff development. 

9. Reconnecting Students at Risk to the Learning Process - 
New visions of learning suggest that students wbo are academical- 
ly at risk have been largely disconnected from the process of learn- 
ing by segregation into poorly coordinated and impoverished 
remedial programs emphasizing drill on isolated skills. Research 
indicates that such students can be reconnected to the learning 
process by training regular classroom teachers to use teach- 
ing/learning strategies which are successful for students in 
heterogeneous classrooms and by providing them with dynamic as- 
sessments and highly enriched learning environments. Video Con- 
ference 9 highlights successful programs. 

Computer Forums Much of the value and excitement of participating in this video 

series arises from the opportunity to interact with presenter* and 
share in the national dialogue on restructuring. Indeed, this 
dialogue is a primary goal of this professional development series. 
Yet, there is only so much time available to engage in such 
dialogue during each video conference. To participate in the con- 
tinuing dialogue after eich video conference, viewers can access 
LEARNING LINK, a computer conferencing system. 
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This system was developed for public television to increase *ne im- 
pact of distance learning. Using this system, members can: 



Who Will Be Available to 
Address Questions and 
Comments? 



What Do I Need To Use 
LEARNING LINK? 



• Ask presenters questions for one month after each video con- 
ference 

• Talk to each other to share experiences, help solve problems, 
learn about resources, and ask for assistance 

• Participate in "discussion groups' 7 organized around specific 
topics such as the thinking curriculum 

• Access calendars for events related to restructuring and teach- 
ing for thinking and understanding 

• Access new information pertinent to the video series such as 
news items, alerts, and announcements of new publications 

• Search user's communications for information and commen- 
tary on specific topics such as assessment 

• Survey what others think about a given issue 

• Access large documents that NCREL enters into the system 
(for example, articles and annotated bibliographies) 

• Exchange strategic plans with others 

NCREL and PBS have asked the presenters if they, or their staff, 
can be available for approximately one month after each video con- 
ference to answer additional questions- While we do not expect 
that ail of the presenters will be available, we anticipate that there 
will be some from each conference in the series. A full-time con- 
ference moderator will be available from Indiana University at 
Bloomington. This person will be able to answer questions per- 
taining to ail aspects of restructuring as well as to respond to tech- 
nical questions and facilitate conference dialogue. 

All you need to apply is a microcomputer (any brand), a modem, 
and telecommunications software such as Apple Access 2, Apple 
Works, Procomm, or Red Ryder. 
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How Much Does Regular account membership is $189.00 for 20 hours of access to 

LEARNING LINK Cost? the system. However, DataAmerica and IBM have partially un- 

derwritten the cost. The first 2,500 people to register will pay only 
$95.00 for 15 hours. Of these special $95.00 memberships, 1,500 
will be reserved for persons in the NCREL region. Memberships 
will be processed on a first-come, first-served basis. For information, 



phone: or wrivg; 

Erica Marks IntroLink 

IntroLink Learning Link National Consortium 

(212) 560-6868 356 W. 58th St. 

9:30-5:30 EST New York, NY 10019 



Note 1: While there may be nominal local connect charges, there 
will be no additional fees for long distance usage for hours of ser- 
vice purchased. This is true whether you pay $189.00 for 20 hours 
or $95.00 for 15 hours. 



Note 2: Members currently using LEARNING LINK service do 
not need to apply. They are already eligible to participate in the 
service for this video series through their local LEARNING LINK 
system. For information, watch for announcements in your bul- 
letin boards. 



Remember: You must already have a microcomputer, a modem, 
and telecommunications software in order to access LEARNING 
LINK. 



Materials Video Conference Guidebooks include pre- and post-conference 

activities as well as other activities for various workshops. Ac- 
tivities are customized for different levels of knowledge. Some ac- 
tivities are introductory; others are more advanced. Each 
downlink site will receive one camera-ready master copy free of 
charge for local reproduction as part of the licensing arrangement. 

Selected Readings include reprints of various articles and other in- 
formation for each video conference. We have created a flyer, in- 
cluding an order form, for you to distribute. This form can be 
found at the end of this book. Two volumes of Selected Readings 
will be available or $15.00 each (plus shipping) from: 



Zaner-Bloser, Inc. (800) 421-3018 

Customer Service 8:00 am - 4:30 pm EST 

1459 King Avenue Fax: (614) 486-5305 
P.O. Box 16764 
Columbus, OH 43216-6764 
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Course Credit 


In the NCREL region (Illinois, Indiana, Iowa, Michigan, Min- 


intorrnauon 


nesota Ohio and Wisconsin^ the National College of Education 




will offer two graduate hours of credit to: 




• Groups of students using an approved on-site facilitator 




• Individuals employing instructional services by telephone 




For more information about credit in the NCREL region, please 




rsill ^onia Clarv Associate Dean for Off-Carnniis Programs ^708^ 

v-uil wvli J oi v^icii j y iujovyvl u IV i— / vail ivi via v-scii ji l/ vao k i v/ti uiiio, ^ / j 




475-1100, ext. 2335. 




In the fall of 1990, PBS Adult Learning Service will offer Restruc- 




turing to Promote Learning in America's Schools as a telecourse. 




For information, please call (800) 257-2578. 


Local Involvement 




Inside the NCREL 


NC\EL has identified local teams from each of its seven states to 


Region 


assist in implementing the video series. Teams include people in 




these areas: media, staff development, curriculum and instruction. 




and rural and urban education. Each team has developed its own 




tmnlpmpntntinn nlan T j ai PR> <:t3tinn<: fhTnnohniit fhp rp<rtnn 

UilL/lvliiVlllallUll UlaJl. JUV ^al k DO olaUUUo llliUUtillUUl lliv IvglUU 




will also be a part of the local outreach. 


Outside the NCREL 


You mav want to generate activities similar to those in the NCREL 


Region 


region. Some suggestions: 




• Your school or agency can provide immediate commentary and 




analysis at the local site after each video conference. 




• Lx>cal colleges or universities may use the series as part of 




course requirements. 




• State education agencies and/or other qualified agencies may 




provide continuing education credits, or equivalent, for par- 




ticipation in the series. 




• Local and state education agencies may provide Leader- 




ship/Management Academy Workshops, study groups, and/or 




other workshops using the video series. 




• Your school may provide school credits/career advancement 




for participation. 
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Video Sources 



Project Zero 



Performance-Based 
Assessment 



This interview of Howard Gardner, including a classroom 
demonstration of Immigrants, was developed and copyrighted by 
NCREL (1990), 

This collage of performance-based assessments was developed and 
copyrighted by Browne & Johnson Production, Inc., One Graftoa 
Common, Grafton, MA 01519. 



California Assessment 
Program (CAP) Test 



This videotape was excerpted fiom Assessing Authentic Achieve- 
ment (1990) with permission of the California State Department of 
Education, Sacramento, CA. 



Hazen Union School 



Key Elementary School 



This interview of Jean Hackett and the video archives of her per- 
formance-based assessments in math was developed and 
copyrighted by NCREL (1990). 

This segment, which includes includes video archives from Key 
Elenentary School plus classroom demonstrations of teachers 
using performance-based assessments, was developed and 
copyrighted by NCREL (1990). 
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Evaluation and Remedial Assistance (EERA) Program and then as the 
Project Director of the Connecticut Assessment of Educational 
Progress (CAEP) Program and currently as Coordinator of the Com- 
mon Core of Learning Assessment She is also principal investigator 
on a National Science Foundation project to develop science and 
mathematics peiformance tests for high school students. Dr. Baron 
was Project Director of the 1984-85 CAEP Science Assessment 
which included a practical hands-on component. The CAEP program 
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Thinking. 
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(1952-54), Universidad de ias Americas, Mexico, D.F. (B.A 1955), 
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67 




59 



Patricia Miller Boianos 



Kathleen B. Comfort 



the statewide CAP Science Assessment Advisory Committee in 
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performance tasks, open-ended questions, and portfolios for grades 6, 
8, and 12. Ms. Comfort has taught science to students in grades 6-12 
in both California and Washington state, and has served as a mentor 
teacher, Science Education Specialist, and Coordinator of Curriculum 
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"Project Zero" that sought to unravel the nature of artistic thinking. 
His woik during the last 15 years as a member (and, more recently, as 
co-director) of Project Zero led to numerous experimental studies and 
to his first book, The Arts and Human Development (1973); many of 
his other writings since then have espoused the cause of development 
and the arts. Dr. Gardner is author of over 250 articles in professional 
journals and wide-circulation periodicals. Among his books are The 
Quest for Mind (1973 - 2nd ed., 1981), The Shattered Mind ( 1975), 
Developmental Psychology (1978 - 2nd ed., 1982), Art, Mind and 
Brain (1982), Frames of Mind (1983), The Mind's New Science 
(1985), and, most recently, To Open Minds: Chinese Clues to the 
Dilenma of American Education (1989). For the last decade, he has 
also spent a large part of his time conducting neuropsychological in- 
vestigations of the effects of brain damage on mental activity, espe- 
cially in the arts. At present, Dr. Gardner serves as Professor of 
Education and Co-Director of Project Zero at the Harvard Graduate 
School of Education. 

Grant P. Wiggins is Director of Educctional Research and Develop- 
ment for CLASS, a Rochester, NY, educational research and consult- 
ing firm. The mission of CLASS is to help schools and districts 
conceptualize and manage change around enhanced student perfor- 
mance, exemplary pedagogy iod adult professionalism. Since 
moving to Rochester, Dr. Wiggins has also worked for the National 




Center on Education ard the Economy on issues of assessment, and is 
working with ue Rochester school district to develop and implement 
more authentic, performance-based forms of student assessment. 
From 1985 to 1988 Dr. Wiggins served as the Director of Research in 
Curriculum and Teaching for the Coalition of Essential Schools, a na- 
tional secondary school reform project involving over 50 schools, 
based at Brown University and headed by Ted Sizen He conducted 
local and regional workshops for teachers in Coalition schools, wrote 
the supporting print materials on curriculum and instruction, 
developed a videotape on the theme of Student As Worker, Teacher 
As Coach, and furthered Sizer's ides of "diploma by exhibition of 
mastery." Dr. Wiggins presently serves as a consultant to the states 
of Vermont, Connecticut, New York, and California on assessment. 
His recent writings include articles on grading in American Educator 
and on "authentic" alternatives to standardized tests in Educational 
Leadership (April '89) and Phi Delta Kappan (May '89). His 15-year 
high-school teaching career spans three disciplines but has been 
rooted in philosophy. Dr. Wiggins was one of a number of pioneers 
in the '70s who developed courses in philosophy (ethics, theories of 
knowledge, etc.) at the secondary level 

Protase E. Woodford Frotase "Woody" Woodford is Head of the Languages Group, Test 

Development, School and Higher Education Programs Division of 
ETS. H „ is the Test Development Coordinator of the Test of English 
as a Foreign Language (TOEFL), Mr. Woodford designed, 
developed, and administered the 'i jst of English for International 
Communication (TOEIC) in collaboration with the Ministry of Inter- 
national Trade and Industry in Japan. He and his Test Development 
Staff were among the first FSI certified testers outside the Federal 
Government when ETS assumed responsibility .from FSI for Peace 
Corps Language Proficiency Testing. The ACTFL-ETS guidelines 
are a direct outgrowth of the "Common Yardstick" project directed by 
him under a Federal grant to establish a common set of descriptors of 
Language Proficiency. In 1970, he and his staff introduced listening 
comprehension tests in French, German, Spanish, Italian, and Russian 
into the College Board's Admission Testing Program. Mr. Woodford 
also directed the ETS Test Development effort for a new generation 
of Defense Language Institute Tests in the 1970s. Under his direc- 
tion, ETS developed ESL (English as a second language) and bilin- 
gual teacher language evaluation programs for New Jersey and Texas 
and z number of other states. Mr. Woodward is the ruthor of more 
than a dozen Spanish and ESL textbooks. Prior to his employment at 
ETA in 1966, he taught Spanish in schools and colleges in New Jer- 
sey, foreign language methodology at the NDEA Institute and in al- 
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(304) 347-0411 



8. Preston Kronkosky, Executive Director 

Southwest Educational Development Laboratory 
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(512) 476-6861 
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Stanley Chow 

Inter-Laboratory Collaboration 
Far West Laboratory 
!855Folsom Street 
San Francisco, CA 94103 
(415) 565-3000 



9. John E. Hopkins, Executive Director 
Research for Better Schools, Inc. 
444 N. Third Street 
Philadelphia, PA 19123 
(215) 574-9300, ext . 201 



3. Larry Hutchins, Executive Director 
Mid-continent Regional Educational Laboratory 
12500 R Iliff, Suite 201 

Aurora, CO 80014 * 
(303) 337-0990 

4. Beau Fly Jones, Program Director 

North Central Regional Educational Laboratory 
295 Emroy 
Elmhurst, IL 60126 
(708)941-7677 

5. Janet M. Phlegar 

The Regional Laboratory for Educational Improvement 

of the Northeast and Islands 
300 Brickstone Square, Suite 900 
Andover, MA 01810 
(508)470-1080 

6. Rex W. Hagans 

Director of Planning and Service Coordination 
Northwest Regional Educational Laboratory 
101 S.W. Main Street 
Suite 500 

Portland, OR 97204 
(503) 275-9543 

7. Peirce Hammond, Deputy Director 
Southeastern Educational Improvement Laboratory 
200 Park, Suite 200 

P.O. Box 12748 

Research Triangle Park, NC 27709 
(919) 549-8216 
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For ordering items below, please send check or purchase order to: 
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Customer Service: (800) 421-3018 
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Fax: (614)486-5305 
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Restructuring to Promote Learning in America's Schools: 
Selected Readings. (Volumes I & fl) 



Transcripts of the video conferences can be ordered for $6.00 each from: 

Smith Business Automation School 
Transcript Services Department 
1313 East Sibley Ave, 
Dolton, IL 60419 



RJC 



71 



63 



NORTH CENTRAL REGIONAL 
EDUCATIONAL LABORATORY 
295 Enuoy Avenue 
Elmhurst. IL 60126 



TO: 



SELECTED READINGS FOR 

Restructuring to Promote Learning in America's Schools 
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